<html>
<head><meta charset="utf-8"><title>i686-gnu* jobs keep timing out · t-infra · Zulip Chat Archive</title></head>
<h2>Stream: <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/index.html">t-infra</a></h2>
<h3>Topic: <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html">i686-gnu* jobs keep timing out</a></h3>

<hr>

<base href="https://rust-lang.zulipchat.com">

<head><link href="https://rust-lang.github.io/zulip_archive/style.css" rel="stylesheet"></head>

<a name="226985638"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/i686-gnu%2A%20jobs%20keep%20timing%20out/near/226985638" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Joshua Nelson <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html#226985638">(Feb 19 2021 at 16:07)</a>:</h4>
<p><a href="https://github.com/rust-lang/rust/pull/82020#issuecomment-782154550">https://github.com/rust-lang/rust/pull/82020#issuecomment-782154550</a></p>



<a name="226986027"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/i686-gnu%2A%20jobs%20keep%20timing%20out/near/226986027" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> tm <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html#226986027">(Feb 19 2021 at 16:10)</a>:</h4>
<p><a href="https://github.com/rust-lang/rust/issues/82221">#82221</a></p>



<a name="226986577"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/i686-gnu%2A%20jobs%20keep%20timing%20out/near/226986577" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> tm <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html#226986577">(Feb 19 2021 at 16:13)</a>:</h4>
<p>makes me wonder if this might be due to long standing bug in <code>std::sync::mpsc::Receiver::recv_timeout</code> (the implementation contains data race) which is used by test crate</p>



<a name="227079373"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/i686-gnu%2A%20jobs%20keep%20timing%20out/near/227079373" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> tm <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html#227079373">(Feb 20 2021 at 09:20)</a>:</h4>
<p>Another random observation: printing functions hold a lock while executing user code, so they can cause a lock order inversion and a deadlock.</p>



<a name="227088347"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/i686-gnu%2A%20jobs%20keep%20timing%20out/near/227088347" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> tm <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html#227088347">(Feb 20 2021 at 12:24)</a>:</h4>
<p>Ugh, even simple print / eprint called from Display impl causes deadlock, when interleaved with reverse situation in another thread :-(.</p>



<a name="227119644"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/i686-gnu%2A%20jobs%20keep%20timing%20out/near/227119644" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> tm <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html#227119644">(Feb 20 2021 at 21:41)</a>:</h4>
<p>Does infra team have an access to CI to gather stack traces of hanged processes?</p>



<a name="227119973"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/i686-gnu%2A%20jobs%20keep%20timing%20out/near/227119973" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> simulacrum <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html#227119973">(Feb 20 2021 at 21:47)</a>:</h4>
<p>No, I don't think so. I guess we could plausibly do some kind of pstack calls periodically from some python script or so on long-running processes... seems complicated :)</p>



<a name="227122169"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/i686-gnu%2A%20jobs%20keep%20timing%20out/near/227122169" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> nagisa <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/i686-gnu*.20jobs.20keep.20timing.20out.html#227122169">(Feb 20 2021 at 22:09)</a>:</h4>
<p>I've seen some people periodically sampling their entire system with perf to retrospectively review issues that occur. I wonder if there's an off-shelf tool that could be utilized there (at least for linuxes)</p>



<hr><p>Last updated: Aug 07 2021 at 22:04 UTC</p>
</html>